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(54) System for fingerprint authentication 



(57) A system and means, which stores, regener- 
ates, or matches shape of curves, by using a specified 
group of data In iength to express a shape of curve. They 
use a sequence of several measure points 
(31 ,32,33,34) on the curve, which are determined so as 



to make the same distances between those adjacent 
measure points. They are the data of lengths of arcs 
(41 ,42,43,44) between starting measure point and end- 
ing measure points among every 3 consecutive meas- 
ure points on the curve. 
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Description 

[0001] The present invention relates to a system for 
fingerprint authentication, which is to extract minutia 
ridge shapes by use of simple data format to recognize 
curves and is to provide fast and effective mechanism 
with less memory space and computation complexity. 
Moreover, the invention achieves a higher identification 
precision for the poor-quality fingerprints by use of sec- 
ondary minutia, false minutia detection, treatment of 
shifted and rotated fingerprint input, pipeline parallel 
processing within 0.24 seconds for raster scan image 
capture and feature extraction processing. The inven- 
tion is used with computer, or any kind of processor or 
dedicated LSI (Large scale integrated circuits). 
[0002] One type of prior art fingerprint authentication 
is to extract position of minutia, which are points of ridge 
endings and bifurcations, in fingerprint images for both 
templates and input sample. Matching or verification is 
performed between extracted data of input sample and 
template. Since fingerprint images of input sample and 
template differ their position, rotation angle and noise 
environment, matching operation has large computa- 
tional complexity such as compensation of shifting and 
rotation, and false minutia elimination. Main reason for 
difficulties in prior art comes from adoption of absolute 
measure, such as position of minutia, which is sensitive 
against shifting, rotation and noise. 
[0003] The present invention is directed to a curve 
recognition system and its application to fingerprint au- 
thentication based on ridge shape information. It is small 
size data format for curves on discrete grids, and relative 
measure robust against shifting, rotation and noise. The 
invention provides fast and accurate fingerprint authen- 
tication algorithm and hardware system with small data 
storages of 50 bytes. Several important techniques are 
included in the invention such as secondary minutia, cri- 
teria for true or false minutia, treatment of shifted and 
rotated fingerprint input, pipeline parallel processing 
within 0.24 seconds for raster scan image capture and 
feature extraction processing, and several useful appli- 
cations such as on-line verification. 
[0004] In the drawings: 

Figure 1 illustrates to derive numerical data to ex- 
press information of minutia ridge shape. 
Figure 2 illustrates the movement and rotation of the 
image to be recognized 

Figure 3 illustrates the principle to calculate approx- 
imately coordinates of measure points, which lo- 
cates between grids 

Figure 4 illustrates another feature data to express 
minutia ridge shape. 

Figure 5 illustrates to extract true minutia by thin- 
ning operation and reverse operation between 
black and white over black and white binary image. 
Figure 6 illustrates algorithm for extraction of true 
minutia including improvement of gray scale image. 



Figure 7 illustrates false minutia, which consists of 

(a) two ending minutia close to each other, 
which posses the same directions as their mi- 
ff nutia ridge shapes. 

(b) an ending minutia near a bifurcation point. 

(c) an ending minutia near boundary of image. 

Figure 8 illustrates process of both reverse of black 
to and white and thinning. 

Figure 9 is an example for describing the secondary 
minutia in associated with a minutia. 
Figure 10 is an example to detect false bifurcation 
minutia in this invention. 
is Figure 1 1 represents 2 dimensional memory areas 
of M rows and L columns for manufacturing without 
compensation for displacement. 
Figure 1 2 illustrates algorithm of feature extraction 
for recognition system by use of raster scan image 
20 capture. 

Figure 13 illustrates algorithm for finger authentica- 
tion system as an example of this invention. 

[0005] Figure 1 illustrates to derive numerical data to 
25 express information of minutia ridge shape. Minutia is a 
special point on the ridge of fingerprints, whether ridge 
is terminated at the point or ridge is bifurcated at the 
point. The former minutia is called ending minutia, while 
the latte is called bifurcation minutia. Minutia ridge is a 
30 ridge leaving from any kinds of minutia Consider a mi- 
nutia ridge, which is smooth curve 40 leaving from mi T 
nutia 30 as shown in Figure 1 . 

[0006] Sampling points (called measure points, here- 
after) 31, 32, 33 and 34 on the ridge are taken in such 

35 a way that arcs 41, 42, 43 and 44 between measure 
points become unit lengths. This is similar way to meas- 
ure path on the curve in the map by use of divider. 
[0007] Based on said arcs, a length of arc 51 is meas- 
ured as a feature, which becomes an arc of triangle com- 

40 prised by the first and the second measure points and 
minutia. 

[0008] Actually, measure points 31 , 32 and 33 are de- 
cided by measuring unit length from previous measure, 
point along the ridge, one by one. The length of arc from 

45 each measure point to its second next measure point is 
measured. As an example, arc 52 from minutia 30 to its 
second next measure point 32 is measured, and arc 53 
from the first measure point 31 to its second next meas- 
ure point 33 is measured. 

so [0009] As a result of this measurement, the numerical 
length data of arcs 51 , 52 and 53 are used as information 
to express the minutia curve shape 40. These simple 
numerical data become fingerprint feature data. 
[0010] By use of matching these fingerprint feature 

55 data with content of database (called template, hereaf- 
ter) registered in advance, the system achieves fast 
matching and high recognition rate with a few memory 
in data size. 
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[0011] Consider the input fingerprint image, in which 
curve 40 moves and rotates as shown in Figure 2. If 
shape of curve 40 is expressed by said numerical data 
such as lengths of arc 51 , 52 and 53, they do not change 
against any move and any rotation of curve. Therefore, 
said numerical data such as 51 , 52 and 53 can recog- 
nize, store, regenerate and distinguish shape of curve 
40 from original curve. Matching or verification of shape 
of curve can be detected by comparing those numerical 
data. 

[0012] Figure 3 illustrates the principle to calculate 
approximately coordinates of measure points, which lo- 
cates between grids. The image captured by digital 
camera or video deck is comprised precisely by a certain 
number of pixels, which react the light in similarto retina 
of human eyes. Though said pixels look precise textile, 
they are placed regularly with a certain period over rec- 
tangular grids. 

[0013] In the case of digital image processing on com- 
puters, image data are represented by values on pixels, 
which lie over rectangular grids as shown in Figure 3. 
Among those pixels, colored pixels are one to represent 
a curve. 

[0014] Therefore, measure point 1 2, which is expect- 
ed to be 4 pixels far from a pixel 100 on the curve, may 
not be on an actual pixel. In this case, location of meas- 
ure point 1 2 must be calculated by location of 2 pixels 
10 and 11 on the curve, which are the closest pixels to 
point of 4 pixels far from the pixel 1 00. As an example : 
location of measure point is calculated by the simple lin- 
ear interpolation between location of pixel 10 and loca- 
tion of pixel 11 . In this way, lengths of arcs 51 , 52 and 
53 are obtained by using measure point 12, whose lo- 
cation is not different from location of pixels. 
[0015] The present invention includes algorithm to 
calculate measure point 12 on the curve 40, which lo- 
cates a specified distance from a point on the curve 401 . 
This algorithm enables to deal images of infinite resolu- 
tion theoretically, if the location between two pixels is 
calculated in the image field of finite resolution. 
[0016] Consider a triangle, consisting of a standard 
point and 2 closest pixels 1 0 and 1 1 on the curve, which 
are direct distance 99 far or close pixel from the standard 
point, respectively. Let an arc between standard point 
1 00 and the first pixel 1 0 denote the first arc. Let an arc 
between standard point 1 00 and the second pixel 11 de- 
note the second arc. Furthermore, let an arc between 
the first arc 10 and the second arc 1 1 denote the third 
arc. Then, a measure point on the third arc is decided 
in such a way that the point divides length of the third 
arc at the same ratio of lengths between the first and 
second arc. This interpolation increases the capability 
of curve recognition to large extent, regardless of the 
precision of this approximation. 

[0017] Figure 4 illustrates another feature data to ex- 
press minutia ridge shape. Let's consider minutia ridge 
shape (400), which extends to reverse direction to bifur- 
cation as shown in Figure 4. Let a point on the ridge 



(400) denote "the second measure point" (402), which 
locates a distance D far from the first measure point. In 
similar way, we measure the 3 rd measure point (403), 
which locates the distance D farther than the second 

5 measure point. Then, we measure the 4 th and 5 th meas- 
ure point (404) and (405), respectively. This procedure 
can be repeated until the ridge terminates or goes out- 
side of boundary of image. Then, a series of arcs be- 
tween adjacent measure points approximates shape of 

10 curve. 

[0018] A effective method to express this piece wise 
linear curve is to measure "directional angle", which is 
defined or calculated by an angle between standard axis 
and line connected from minutia (401) to the 1 st meas- 

is ure point. Then, "the first curvature" is measured, which 
is defined or calculated by an angle between line con- 
nected from minutia (1) to the 2nd measure point (402) 
and line connected from the 2nd measure point (402) to 
the 3rd measure point (403). Similarly, "the second cur- 

20 vature" is measured, which is defined or calculated by 
an angle between line connected from the 2 nd measure 
point (402) to the 3rd measure point (403) and line con- 
nected from the 3 rd measure point (403) and the 4 th 
measure point (404). In this way, angles are measured 

25 between adjacent lines, which are connected between 
measure points along the ridge. Thus, the necessary in- 
formation becomes directional angle of minutia (408) 
and group of curvatures between adjacent lines (409) 
(410) (411). 

30 [0019] Since the directional angle and group of cur- 
vatures express well a ridge shape, the capability of 
curve recognition is greatly improved by use of the in- 
formation. This expression can be applied to not onry 
bifurcation minutia, but ending minutia. 
35 [0020] Figure 5 illustrates to extract true minutia by 
thinning operation and reverse operation between black 
and white over black and white binary image. The orig- 
inal black and white image is processed by cascade 
connection of thinning block (Step S7) and compensa- 
te? tion block of false minutia (Step SB). 

[0021] The contour along ridge of black object in black 
and white image is reduced to 1 pixel in width. Thinning 
is conversion from area to line as shown in Step S7. 
More detail thinning process is described later accord - 
45 ing to Figure 8. 

[0022] The first extraction of ending minutia in original 
black and white image, black and white reversal process 
(Step S70) and the second cascade processing over re- 
versal image, and the second extraction of ending mi- 
50 nutia in reversal image can be performed without ex- 
tracting both ending and bifurcation minutia. This is also 
described in detail according to Figure 8. 
[0023] This scheme makes algorithm more suitable, 
faster and more accurate to treat huge number of tem- 
55 plates and samples without using large memory area 
and with simple hardware. 

[0024] Figure 6 illustrates algorithm for extraction of 
true minutia including improvement of gray scale image. 
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Contrast of block, partitioned by block partitioning, is en- 
hanced until it becomes binary image of black and while. 
This is the first binarization step. Then, ridge direction 
is calculated by ridge direction detection. 
[0025] This ridge direction is used as a secondary in- 
formation in eliminating noise component. Image infor- 
mation along ridge direction is judged as a valid infor- 
mation of ridge, while image information not along ridge 
direction is considered as a noise. This process is called 
as improvement of gray scale image. 
[0026] Binarization is originally a process for analog 
signal to be digital ized, Here, this term is used as a proc- 
ess to convert 8 bit gray scale data into 2 bit black and 
white data. 

[0027] Figure 7 illustrates false minutia, which con- 
sists of 

(a) two ending minutia (20) close to each other, 
which posses the same directions as their minutia 
ridge shapes. 

(b) an ending minutia (21) hear a bifurcation point. 

(c) an ending minutia (22) near boundary of image. 

[0028] After false minutia elimination (Step S8), which 
compensates noise components in said fingerprint data, 
the next procedure goes to extraction of true minutia 
(Step S9). Detail true minutia extraction (Step 8) is ex- 
plained as a post processing according to Figure 7. 
[0029] Figure 7 (a) (b) (c) illustrates 3 kinds of false 
minutia described as above, which are falsely recog- 
nized as true minutia. Compensation rule for false mi- 
nutia is adopted as a post processing, which adds ridge 
to connect two ending minutia close to each other with 
the same direction or an ending minutia close to bifur- 
cation point, or an ending minutia close to boundary of 
image. 

[0030] Referring to Figure 6 again, contrast of said im- 
proved image is enhanced up to obtain btnarized image 
(Step S6). This binary image is derived from compress- 
ing width towards the center in thinning process (Step 
S7). 

[0031] Thinning process (Step S7) brings an addition- 
al effect on simplifying complicated verification process. 
[0032] At next, false minutia compensation (Step S8) 
is performed, which adds ridge to connect two ending 
minutia 20 close to each other with the same direction 
or an ending minutia 22 close to bifurcation point, cr an 
ending minutia 22 near the boundary. 
[0033] In this way, minutia extraction (Step S9) ex- 
tracts remaining ending and bifurcation points as true 
minutia, after an above sequence of processing is ap- 
plied over the input image, including compensation of 
false minutia. The fingerprint verification based on this 
method reveals high verification rate for noisy input im- 
ages. 

[0034] Figure 8 illustrates process of both reverse of 
black and white and thinning. In Figure 8, (a) corre- 
sponds to black and white picture before processing, (b) 



corresponds to intermediate result for minutia extrac- 
tion, (c) corresponds to black and white reverse image, 
(d) corresponds to extracted minutia after the final 
processing. 

5 [0035] The true minutia extraction with thinning (Step 
S7) and reverse of black and white image (S70) was 
explained by using Figure 5. Though great reduction of 
image information is achieved, there still remains diffi- 
culty to digitalize bifurcation points. 
10 [0036] Similarly, great reduction of information is 
achieved as shown in Figure 8(b) and Figure 8(a). How- 
ever, there still remains critical problems, to which a 
unique judge can not be applied. 
[0037] Therefore, in order not to deal with bifurcation 

is minutia, the processing as shown in Figure 8 (a) to (c) 
is performed over reverse black and white image (Step 
S70). Then : thinning process (Step S 7) as shown in Fig- 
ure 8 (c) and (d) leads to ending of finite curve, i.e., end- 
ing minutia instead of said bifurcation. This processing 

20 is repeated twice. 

[0038] in such a way, the finite curves are extracted, 
which do not include any bifurcation or any intersection 
of rides This scheme reduces amount of necessary in- 
formation to express fingerprint, and thus : makes nu- 

25 merical expression easy. The numerical Information be- 
comes quite small in comparison with original image. 
[0039] In this way, fingerprint verification can be 
uniquely performed. Since no judge of human being is 
required, fast processing with small memory capacity 

30 and small load for database become possible. 

[0040] Figure 9 is an example for describing the sec- 
ondary minutia in associated with a minutia (91). Ac- 
cording to direction of minutia ridge, vertical axis (Y1) is 
set. Consequently, horizontal axis (X2) is decided as 

35 shown in Figure 9. The four points (92) (93) (94) (95) 
are determined on the axis in such a way that the dis- 
tances between these 4 points and the minutia (91) are 
the same. 

[0041] The ridge shapes (RS1) (RS2) (RS3) (RS4) 

40 leaving from the nearest point on the ridge (herein, 
called as "secondary minutia") to those four points are 
extracted by use of said curve recognition method, re- 
spectively. These ridge shapes are additional informa- 
tion in associated with original minutia (91 ) to express 

45 features of fingerprint. The fingerprint authentication 
system with ridge shapes of secondary minutia brings 
the tremendous improvement on precision of matching. 
[0042] Figure 10 is an example to detect false bifur- 
cation minutia in this invention. True bifurcation minutia 

50 in most cases partitions area into 3 parts, which consists 
of one narrow angular area (A1 01 ) and two wide angular 
areas (A102) (A103) . The same things can be said for 
bifurcation minutia in valley. Bifurcation minutia in valley 
in associated with the ending minutia partitions area into 

55 similar 3 parts of 1 narrow angular area and 2 wide an- 
gular areas. 

[0043] This characteristic is used to judge whether a 
detected minutia is true or false. For this purpose, 3 



4 



7 



EP 1 197 912 A2 



8 



points on each ridge or each valley line are selected in 
such a way that they are the same distance far from the 
bifurcation minutia. Let 3 points denote as points (102) 
(103) (104), whose coordinates are (Xa, Ya), (Xb, Yb) 
and (Xc, Yc) respectively in coordinate system of origin 5 

(101) . 

[0044] With regards to a point pair of point (102) and 
point (1 03) , we calculate the sum (XaXb+YaYb) of prod- 
uct (XaXb) of horizontal coordinate pair and product 
(YaYb) of vertical coordinate pair of two points. Herein, 10 
the sum (XaXb+YaYb) is called as "an inner product of 
2 points". The value of this inner product corresponds 
to cosine function of the angle between a line of (101) 

(1 02) and a line of (1 01 ) (1 03). It means that if the value 

is large, the angle between two lines is narrow and if '5 
otherwise, the angle between two lines is wide. In similar 
way, an inner product of two line pair of (101) (103) and 

(101) (104), and an Inner product of two line pair of (101) 

(102) and (101) (104) are calculated. 

[0045] The point (101) is judged as a true minutia if 20 
there exists only 1 greater inner product among these 3 
inner products. This case corresponds to the situation 
of true bifurcation minutia, where only one narrow an- 
gular area exists. Otherwise, the point (101) is judged 
as a false minutia. 25 
[0046] Even if two fingerprint images of identical fin- 
ger are captured by the system, positions and directions 
of extracted minutia are not the same. They depend on 
the positions and angles of the finger put on an input 
sensor. For matching between two fingerprint images. 30 
one of images should be compensated before compar- 
ison in the conventional method. To specify displace- 
ment and rotation and to compensate them need tre- 
mendous amount of computation. In order to avoid this 
difficulty, it is usually that displacement and rotation of 35 
input fingerprint image are strictly restricted. The 
present invention p resents the matching method without 
compensation for displacement due to simple shifting. 
[0047] Figure 11 represents 2 dimensional memory 
areas of M rows and L columns. Before the process of 40 
fingerprint matching, memory areas are supposed to 
have initial values such as zero. 

[0048] Here, consider similarity measure of any kinds, 
whose numerical values correspond to how similar any 
pair of minutia in two fingerprint images. This similarity 45 
measure is calculated based on the ridge direction and 
similarity of curve shape. If pair of minutia is quite sim- 
ilar, a value of similarity function becomes large. On the 
other hand, if pair of minutia is not so similar, a value of 
the similarity function becomes small. 50 
[0049] For said two minutia, let (Xa, Ya) and (Xb, Yb) 
denote 2 dimensional coordinates in two fingerprint im- 
ages, respectively. 2 dimensional vector (Xb-Xa, Yb-Ya) 
is a vector from position of minutia in one fingerprint im- 
age to position of minutia in the other fingerprint image. 55 
This means that the minutia shifted with (Xb-Xa) along 
horizontal direction and (Yb-Ya) along vertical direction 
if the former minutia matches with the latter one. If the 



value of similarity function between two minutia is large, 
the possibility of displacement (Xb-Xa, Yb-Ya) of the 
former fingerprint image is high. On the contrary, if the 
value of similarity function between two minutia in dif- 
ferent fingerprint images is small, the possibility of dis- 
placement (Xb-Xa, Yb-Ya) of the former fingerprint im- 
age is small. 

[0050] After a comparison between two minutia in dif- 
ferent fingerprint images, the value of similarity measure 
is added to the value, which is stored in memory area 
of (Xb-Xa, Yb-Ya) corresponding to said 2 dimensional 
vector (Xb-Xa, Yb-Ya). A sequence of operations is re- 
peated for comparison between each minutia pair in dif- 
ferent fingerprint images. 

[0051 ] As a result, the values in the memory distribute - 
over different addresses because of inaccuracy of posi- 
tion estimation of extracted minutia. If minutia positions 
are accurately extracted, the strong peak value can be 
expected in the memory. On the contrary, in case two 
minutia are produced by different fingers, the same op- 
eration may bring the distribution of values in memory 
without any large peak value. 

[0052] However, since to specify amount of displace- 
ment is not a final purpose, the maximum value in mem- 
ory is directly evaluated. If it exceeds a certain threshold 
value, two input fingerprints are concluded to be identi- 
cal. Otherwise, two input fingerprints are likely to be dif- 
ferent. 

[0053] The present invention gives a solution not only 
for shifting, but for rotation of fingerprint images by use 
of said matching method without using any compensa- 
tion of shifting. To compensate displacement due to ro- 
tation, all the minutia of input fingerprint image are com- 
pensated for rotation. Remind that feature data in the 
present invention consists of 2 dimensional coordinates 
and the information for minutia ridge shape. The 2 di- 
mensional coordinates or position of minutia are com- 
pensated by rotation around a standard origin with a cer- 
tain angle. Among information for minutia ridge shape, 
directional angle of minutia is also compensated to the 
same extent. However compensation is not necessary 
for curvatures of minutia ridges because they are invar- 
iant against rotation. After compensating all minutia 
ridge shapes with the angle, the method without com- 
pensation of shifting is applied to do matching between 
two fingerprint images. 

[0054] Since rotation angle is not known, the above 
processing is repeated for different angle of rotation until 
a rotation angle is specified by getting the largest values 
in memory. 

[0055] Figure 12 illustrates algorithm of reature ex- 
traction for recognition system by use of raster scan im- 
age capture. Camera image capture, which is similar to 
raster scan TV set, sends one frame data in a certain 
period of time to DSP. Camera scans sequence of 
frames at a certain frame rate such as 25 or 30 frames 
per second. In each frame, a block data of partial area 
in a frame is stored (Step S92). Then, feature extraction 
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processing (Step S93) is performed in limited short time 
as shown in Figure 5 and 6. 

[0056] Feature extraction processing (Step S93) is 
performed by computer, which executes 1 million in- 
structions per second. Assuming that fingerprint feature s 
data of 50 bytes is assigned to computer, it takes about 
0.24 second for feature extraction (Step S93) and their 
storages. This verification time corresponds to time for 
6 or 7 frame in raster scan system of 25 or 30 frames 
per second. 10 
[0057] Actually, consecutive 5, 6 or 7 frames are re- 
quired under the assumption that input fingerprint imag- 
es are identical among those frames. Feature extraction 
(Step S93) and storage of feature data (Step S94) for 
whole fingerprint image completes within raster scan is 
time for 5, 6 or 7 frames. Then, termination of whole im- 
age processing (Step S95) also terminates algorithm. 
[0058] Figure 13 illustrates algorithm for finger au- 
thentication system as an example of this invention. 
[0059] Processing from camera image input (Step S1 ) 20 
to true minutia extraction (Step S9) and then termination 
of whole image processing (Step S95) consists of partial 
algorithms explained with Figure 5, 6, 7, 8 and 9. 
[0060] Block thinning (Step S2) after camera image 
input (Step S1 ) is always necessary in actual implemen- 25 
tation, which leads to binarization (Step S3) and im- 
provement of gray scale image (S5) for each partitioned 
block image. 

[0061] When the result of termination of whole image 
processing is "YES", the next step becomes either 30 
matching process (Step S74) or storage in database of 
fingerprints (Step S75). In matching process (Step S74) : 
extracted feature data in the form of numerical data is 
used to compare with templates stored in database of 
fingerprints. 35 
[0062] In block processing, blocking noise is usually 
generated, which is seen as discontinuity of images on 
the boundary of blocks. The noise is eliminated by soft- 
ware. In order not to lose necessary information and to 
keep or capture information of whole image, boundary 40 
data of blocks overlap with data in adjacent blocks. 
[0063] In this way, computer with ability of 1 million 
instructions per second, performs a sequence of 
processing such as noise elimination of input fingerprint 
image, image improvement, binarization, thinning, elim- 45 
ination of false minutia and matching with database, 
within 0.24 seconds by use of from 40 to 60 bytes data 
for extracted features. 

[0064] Herein, improvement and various kinds of 
processing are explained in detail. Ridge direction is ex- so 
tracted from fingerprint image before partitioning into 
blocks as shown in Figure 6 and Figure 1 3. Then, direc- 
tional fitter, not shown in figure, is used for said improve- 
ment of gray scale image (Step S5). When fingerprint 
image is input to directional filter, it is modified if a part ss 
of image is quite different from ridge shape of normal 
fingerprint. Modification is performed by computer, but 
it resembles such a human's action that contour of the 



ridge is redrawn by hand to make ridge image clearer. 
[0065] Sophisticate software is implemented on Dig- 
ital Signal Processor (hereafter, called as DSP). It is 
quite similar to such human's action that parts to be 
modified are detected by eyes and modified by hand 
based on estimation derived from ridge direction infor- 
mation around them. 

[0066] Block thinning is a processing of each block, 
obtained by partitioning raster scanned whole image in- 
to rectangular array. It leads to unique processing by 
simplifying complex image processing, which is not suit- 
able for computers. If width of a ridge is reduced to one 
pixel in size, minutia ridge shape becomes a simple line 
connected to the minutia. It enables machine recogni- 
tion with unique processing. 

[0067] For those processing, whole information for 
said block image is not stored in memory at a time. Local 
minutia 30, which are robust against rotation, shifting 
and noise, and their associated arcs 51 , 52, 53, are ex- 
tracted by local processing soon after block image is 
read. While, the other raster scanned block images are . 
not read during processing of the block. This scheme 
reduces required memory capacity. 
[0068] Actual system configuration consists of com- 
pact video camera and Digital Signal Processor (DSP). 
Algorithm in this invention is stored as program in DSP. 
[0069] 32 x 22 pixel image in each small block is se- 
lected from 200 x 200 =40,000 pixels, which are whole 
image input from video camera in raster scan fashion. 
They are stored temporary in data memory of DSP. By 
described processing, information of minutia ridge 
shape is extracted as numerical data, based on meas- 
ure points 31 , 32, 33, 34 on ridge 40. 
[0070] Next input data of another block image is proc- 
essed in the same way Since it takes time to extract 
arcs 51 , 52, 53 as feature data, consecutive block image 
is not processed in the same frame. Since computer is 
busy to extract minutia ridge shape information, it does 
not accept new input information during processing so 
as to save memory capacity. 

[0071 ] Since each block processing can be performed 
independently on each other, 6 frames are input to cover 
whole image area under raster scan speed of 25 frame 
per second (corresponding to PAL or SECAM in Europe 
and Russia). In other words, a little bit more than 1/6 
image data of each frame is input to computer. De- 
scribed overlapped image between adjacent blocks 
makes data size of each frame greater than 1/6 image 
data 

[0072] Since it takes at least about 0.24 seconds for 
said DSP to extract said minutia ridge shape informa- 
tion, whole image area cannot be covered by 1 frame 
raster scan input. 1 frame raster scanning takes similar 
time to 1/25 or 1/30 (NTSC in US and Japan) seconds. 
Therefore, during time of 6/25 or 7/30 seconds to scan 
6 or 7 frames, consecutive operations, such as capture 
of partitioned block image and processing of the image 
to final format as feature data, are repeated. 
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[0073] In practical application of fingerprint authenti- 
cation system, template data, which are also extracted 
feature data of fingerprint are stored in advance in mem- 
ory of DSP or database in host computer. Then, input 
feature data is extracted as a sample from input finger- 5 
print image for verification. The data is matched with 
several templates registered in database. By using cri- 
teria for verification, the system judges whether input 
fingerprint is accepted or rejected by the system. 
[0074] As a measure to evaluate fingerprint authenti- io 
cation system, there are two kinds of measure, which 
are false acceptance ratio (referring FAR) and false re- 
jection ratio (referring to FRR). FAR is a ratio between 
falsely accepted samples (unregistered fingerprint), 
among many samples for verification. Ideal system re- '5 
quires that FAR is zero. However, zero FAR means the 
complete verification system, which may reject not only^ . 
unregistered samples, but some of registered samples. . 
[0075] On the other hand, FRR is a ratio between 
falsely rejected samples (registered fingerprints) among 20 
many samples for verification. In practical system, FRR 
and FAR are closely related with each other. Those val- 
ues traded off by changing a threshold value, which is 
used to judge acceptance or rejection in verification. A 
score as a similarity measure is usually generated as a 25 
result of matching between input sample and registered 
template. If the higher threshold is set, FAR become 
smaller, while FRR become larger. * 
[0076] This invention succeeds to achieve FRR less 
than 1 .2% when FAR is set to be zero. The result is com- 30 
pared with world top data of 27.72%. This improvement 
also means the improvement of recognition ability 
against rotated, shifted and noisy input fingerprint imag- 
es. 4 

[0077] Extraction of 50 bytes feature data and verifi- 35 
cation in this invention is actually implemented on DSP 
in speed of 1 million instructions per second. It takes 
0.24 seconds for a sequence of processing such as 
noise elimination, image improvement, binarization, 
thinning and verification. This time shows greater im- 40 
provementthan conventional one in terms of speed and 
accuracy. 

[0078] When this invention is used over networks to 
connect to an information center, which stores finger- 
print feature templates, the system works as on-line per- 45 
sonal authentication system accessed in remote. 
[0079] The rule to authenticate registered person by 
logical operation such as AND, NAND, OR, and NOR of 
fingerprint feature data of plural fingers. For an example, 
the acceptance rule at home may be OR operation so 
among fingerprints of thumbs of father mother and all 
children. For another example, it may also be applicable 
to authentication of car driving according to damage in- 
surance for automobile accidents limited to drivers in 
family. 55 
[0080] Since each person has 20 fingers, their com- 
binations posses more variety than encryption. In addi- 
tion to that, the ability to protect personal rights is in- 



creased more strongly than encryption. If the accept- 
ance rule of AND operation of both thumb and baby fin- 
gers is adopted, its ability become tremendous. 
[0081] Even if a new law in terms of electronic com- 
merce in United States of America permits "encryption 
possesses equivalent lawful effect on signature", it is 
concluded as a usual and final decision in terms of per- 
sonal authentication that fingerprint authentication will 
keep priority to encryption. 

[0082] In summary, the present invention provides a 
curve recognition system and its application to finger- 
print authentication based on ridge shape information, 
which achieves small size data format for curves on dis- 
crete grids, fast and accurate fingerprint authentication, 
algorithm and hardware system with small data storag- 
es. Several important techniques are included in the 
convention such as ridge shape of secondary points, 
true and false minutia detection, treatment of shifted and. 
rotated input of fingerprint image, pipeline parallel 
processing for raster scan image capture and feature 
extraction processing, and several useful applications. 

Claims 

1 . A system for fingerprint authentication 
characterised in that the system 

stores, regenerates, or matches shape of 
curves, by using a -specified group of data in 
length and/or angle and/or position to express 
a shape of curve, in said system using se- 
quence of several measure points on the curve, 
which are determined so as to make the same 
distances between those adjacent measure 
points, the data of lengths of arcs being be- 
tween starting measure point and ending 
measure points among every 3 consecutive 
measure points on the curve. 

2. The system as in claim 1 for recognition of curve 
expressed on the periodic discrete grids such as 
digital image, which determines position of meas- 
ure points by interpolating positions of two nearest 
adjacent grids on the curve, whose distances from 
starting measure point are less and greater than the 
specified value, respectively. 

3. A system as in claim 1 or claim 2 for fingerprint au- 
thentication, comprising a sequence of processing: 

means for block partitioning to partition whole 
image data into plural pieces of blocks. 
. means for the first binarization to make gray 
scale image a binary black and white image by 
enhancing contrast of original image, 
means for deriving directions of ridge in binary 
image. 
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means for noise elimination to eliminate black 
data not located along directions of ridge, 
means for the second binarization to make gray 
scale image a binary data by enhancing con- 
trast of original images. 5 
means for thinning by reducing width of ridge 
until ridge width becomes one pixel in size, 
means for false minutia elimination to eliminate 
plural minutia located closely to each other 
endingminutia located near bifurcation minutia, 10 
minutia located closely to image boundary, and 
isolated minutia without ridge, and 
means for extracting minutia to adopt remain- 
ing minutia as true minutia after above false mi- 
nutia elimination. is 

4. A system as in anyone of claims 1 to 3, wherein it 
. utilizes, as a additional feature. of fingerprints, both 

said minutia ridge shape and said ridge shape of 
seconcary minutia, whose position is determined in 20 
associated with each minutia. 

5. A system as in claim 3 s wherein two kinds of extrac- 
tion means for ending minutia are performed over 
original black and white image and its reversed 25 
black, instead of extracting both ending and bifur- 
cation minutia over original black and white image. 

6. A system as in any one of claims 1 to 5, wherein it 
includes a cost effective calculation for judging true 30 
or false minutia, comprising: 

means for taking 2 dimension coordinates with 
an origin of a bifurcation point, 
means for taking 3 points on different ridges 35 
leaving from the bifurcation point with the same 
distances from the bifurcation point, 
means for calculating all inner products of 2 
point vector selected from said 3 points, where- 
in inner product means sum of multiplication of 40 
horizontal components of said 2 points with 
each other and multiplication of vertical compo- 
nents of said 2 points with each other, 
means forjudging the bifurcation as a false bi- 
furcation minutia if all 3 said inner products are 45 
less than a specified value. Otherwise, judging 
the bifurcation as a true bifurcation minutia. 
means forjudging ridge ending as a false end- 
ing minutia by using the similar inner products 
over valleys if all 3 said inner products are less so 
than a specified value. Otherwise, judging the 
ending as a true ending minutia. 

7. A system for fingerprint authentication as in 

any one of claims 1 to 6, wherein under assumption ss 
of consecutive frame inputs of identical fingerprints, 
a different part of fingerprint image is processed in 
said way to generate numerical data for each frame 



input of fingerprint image and processing of a whole 
fingerprint image is completed for plural frame In- 
puts of fingerprint image. 

8. A system for fingerprint authentication wherein it us- 
es means of judge on fingerprint verification without 
compensation for displacement of Input fingerprint 
image, comprising 

means for employing memory area in 2 dimen- 
sional coordinates forjudge: 
means for calculating a similarity measure for 
each pair of minutia data between input finger- 
print imajge and registered template fingerprint, 
means for accumulating the similarity measure 
in the memory area, whose coordinates are the 
same as vectors between the positions of the; 
said 2 minutia. The similarity measure means 
any numerical data to express similarity be- 
tween 2 minutia. 

means forjudging input fingerprint as the same 
registered one if the maximum value in memory 
area exceeds a specified value. 

9. A curve recognition system or means for fingerprint 
authentication, wherein It is robust against any ro- 
tation and displacement of input fingerprint image, 
comprising, 

means for rotating coordinates of all minutia 
with a rotation angle around a specified origin, 
means for compensating minutia ridge shape 
for rotation of the said same angle, means for 
employing fingerprint matching method without- 
compensation of displacement of fingerprints 
as in claim 10. 

10. A curve recognition system as in claim 9, wherein 
under assumption of consecutive several frame in- 
puts of identical fingerprint, it takes 6 th of 25 sec- 
onds to complete processing from image capture to 
numerical processing, which corresponds to input 
time of 6 or 7 frames. 

11. A system as in any one of claims 1 to 7. for finger- 
print authentication, comprising 

means for extracting said numerical data of 
said fingerprint ridge shapes of ridge leaving 
from said minutia. 

means for matching numerical data with tem- 
plate samples registered in advance or data- 
base in said way. 

12. A system as in any one of claims 1 to 7, wherein on 
100 MOPS computer, it performs a sequence of 
processing as said thinning, said improvement or 
said compensation, said binarization, said thinning, 
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said collection and said matching of fingerprint fea- 
ture data expressed by 40 or 60 bytes data in size. 
MOPS means unit of operation speed of computer, 
which represents million operations in one second. 

5 

13. A system as in any one of claims 1 to 7, comprising 

means for extracting said fingerprint feature da- 
ta of 40 or 60 bytes from said fingerprint tem- 
plate transferred from outer device or terminal 10 
equipment. 

means for transferring result of marching with 
said templates through communication net- 
work to outer device or terminal equipment. 

15 

14. A system as in any one of claims 1 to 7, wherein it 
is used with terminal or stand-alone equipment, 
which posses a function such as search for person- 
al history, key lock, issue of various tickets, access 
control and toll of gates, electric commerce, and 20 
fund management in medical, social welfare, serv- 
ice, public service, and financial organization. 

15. A system as in any one of claims 1 to 7, wherein it 

is embedded in hardware or software as a part of 25 
design data protection. To use the hardware or soft- 
ware requires personal authentication with finger- 
■ prints. 

16. A system as in any one of claims 1 to 7, wherein 30 
criteria of acceptance is decided by logic operations 
among extracted feature data of plural fingerprints. 
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FIG.1 



Derivation of numerical data of minutia ridge snap 
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FIG.3 

Principle to calculate approximately coordinates of measure 
points, which locates between grids 
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FIG.5 



Algorithm for extraction of extract true, rninutia 
thinning operation and reverse operation between black and 
white over black and white binary image 
Input original black and white image 
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FIG.6 



Algorithm for extraction of true minutia including 
improvement of gray scale image 
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direction 
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FIG.7 



False feature point 



(a) 



Two ending minutia close to each other, which posses 
the same directions as their minutia ridge shapes 




(b) Ending minutia near a bifurcation point 




(c) Ending minutia near boundary of image 
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FIG.8 



Extraction of minutia by thinning and reverse operations 
between black and white over black 



( . Black and white image 
^ before treatment 



(b) Intermediate extracted minutia 
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Reverse operation 



(c) Black and white reversal image (d) 



Tinning 



Extracted minutia after 
final treatment 
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FIG. 10 



Judgment of removal of false 
minutia utilizing scalar product 1 
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FIG.11 



Memory area stores accumulated similarity measure in collation 
without compensation of difference of minutia pair in positions 



Difference in positions of minutia = 
Accumulated similarity measure of minutia pair with 
difference (1,1) in positions of minutia 
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FIG, 12 



Algorithm of feature extraction for recognition 
system by use of raster scan image capture 



Start 



Si- 



Input image from TV camera 
(Raster Scanning) 



S92- 



Store a block data of 
partial area in a frame 



S93- 



Perform feature 
extraction processing 




21 



EP1 197 912 A2 

FIG. 13 



Algorithm for finger authentication system 
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